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DESCRIPTION 

PICTURE PROCESSING APPARATUS AND PHOTOGRAPHING DEVICE 
Technical Field 

The present invention relates to a picture 
5 processing apparatus for processing a photographed 

picture photographed by a photographing device, in 
particular, to a picture processing apparatus for 
obtaining the difference between picture frames so as 
to obtain a temporal change of brightness of an object. 
J.0 More specifically, the present invention relates to a 

picture processing apparatus of which a photographing 



?! ^ device and a storing portion for storing photographed 

! >0 data photographed by the photographing device are 

if] 

!: 4 disposed on the same circuit so as to speed up a 

•:315 calculating process, in particular, to a picture 

in 

15 processing apparatus for suppressing characteristics of 



the storing portion from fluctuating even if a temporal 
change of brightness of an object is small so as to 
obtain an accurate calculation output. 
20 Background Art 

With a picture of an object photographed as a 
first frame and a picture of the object photographed as 
a second frame, the temporal change of brightness of 
the object can be obtained. 
25 Conventionally, when the difference between 

pictures is obtained, a camera that is equipped with a 
photographing device such as a CCD (Charge Coupled 
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Device) , a plurality of frame memories, and an 
calculating apparatus are prepared and connected. In 
other words, picture data of a first frame that is 
output from the camera is temporarily stored in a frame 
memory. Thereafter, picture data of a second frame 
that is photographed is stored in another frame memory. 
The calculating apparatus synchronously reads the 
contents (namely, picture data) stored in the frame 
memories and calculates the difference of the 
corresponding pictures . 

However, conventionally, since picture data 
is transferred from the camera to the frame memories in 
the serial method, the transfer time for one screen is 
not as short as ignored. For example, in an NTSC 
(National Television System Committee) type camera of 
which the CCD is used as a photographing device, while 
a picture of one frame is being photographed, a picture 
of the preceding frame is read. Thus, until a picture 
of one frame is read and transferred, it takes as long 
as 33 msec. Consequently, after a picture is 
photographed, until the calculated result is obtained, 
it takes at least 33 msec. 

Fig. 10 shows a timing chart of which a 
photographed picture is stored and read in the CCD as a 
photographing device. As shown in Fig. 10, it takes 33 
msec until a picture of each of odd fields and even 
fields is stored. In addition, as shown in Fig. 10, 



unless the read period for a picture of the second 
frame elapses, the calculated result cannot be 
obtained . 

Thus, it is difficult to apply the 
conventional photographing system using a camera 
composed of a CCD photographing device to a controlling 
system using visual information such as visual 
feedback. 

On other hand, in a prototype CMOS image 
sensor, the frame rate is raised to as high as around 1 
kHz and while pictures are being photographed at very 
high speed, a calculating process is successively 
performed so as to accomplish the visual feedback. 
However, in such a sensor, since internal processes are 
digitally performed, it is necessary to provide for 
example an AD converting circuit for converting analog 
values into digital values, a storing circuit for 
storing digital values, and a calculating circuit for 
calculating digital values. Since these circuit 
modules have large circuit scales, they are not 
suitable for a many-pixel device. Thus, it is 
difficult to commercially use such a sensor (refer to 
"Designing ultra parallel, ultra high speed vision chip 
using general purpose processing element (translated 
title)" by Komuro et. al . , Journal of The Institute of 
Electronics, Information and Communication Engineers, 
Japan, Vol. J81-D-1, No. 2, pp. 70 - 76, 1998) . 



In addition, a CMOS image sensor for 
calculating analog signals as they are has been 
proposed. In such sensors, a memory function is 
accomplished by storing a signal voltage to a 
capacitor. Thus, depending on how a capacitor is 
structured, each pixel becomes large. Even if the 
number of pixels can be increased by disposing a memory 
portion at a non-pixel area, it cannot be stated that 
such a method is suitable for reducing the size of the 
chip . 

In addition, when a signal voltage is stored 
to. a capacitor, if a signal voltage of another 
capacitor is read as a gate voltage of another 
transistor, since threshold voltages of individual 
transistors fluctuate, there is a risk of which the one 
signal is read as different values. As a result, the 
calculated result may contain an error. In addition, 
when a signal voltage is stored to a capacitor, since 
the charging time cannot *be ignored, such sensors are 
not suitable for high speed processes. 
Disclosure of the Invention 

Therefore, an object of the present invention 
is to provide an excellent picture processing apparatus 
for obtaining the difference between picture frames so 
as to obtain a temporal change of brightness of an 
obj ect . 

Another object of the present invention is to 



provide an excellent picture processing apparatus of 
which a photographing device and a storing portion for 
storing photographed data photographed thereby are 
disposed on the same circuit so as to perform a 
calculating process at high speed. 

A further object of the present invention is 
to provide an excellent picture processing apparatus 
that allows characteristics of a storing portion to be 
suppressed from fluctuating and an accurately 
calculated output to be obtained in a situation of 
which a temporal change of brightness of an object is 
small. 

The present invention is made from the above- 
described point of view. A first aspect of the present 
invention is a picture processing apparatus, 
comprising : 

a light receiving portion for generating an 
electric signal corresponding to intensity of received 
light, 

an amplifying portion for amplifying an 
output signal of the light receiving portion, 

a plurality of storing portions for storing 
as a current signal an electric signal amplified by the 
amplifying portion , 

a load portion for converting current outputs 
of the plurality of storing portions into voltages, 

a bias portion for supplying a'n offset 



current to an input of the load portion, 

a calculating portion for calculating an 

output signal of the load portion, and 

an outputting portion for outputting a 

calculated result of the calculating portion to the 

outside . 

In the picture processing apparatus of the 
first aspect of the present invention, the plurality of 
storing portions may store current signals 
corresponding to the received light in different 
periods. In this case, the calculating portion may 
perform a calculating process such as an addition, a 
subtraction, or a comparison for the voltage signals 
based on the current signals extracted from at least 
two of the plurality of storing portions. 

The amplifying portion may contain mirror 
transistors that are connected so that their gate 
electrodes face each other and amplify the current 
signals based on the theory of current mirror. 

The storing portion may store the current 
signals based on the theory of current copier. 

When the calculating portion compares the 
signal currents supplied from two of the plurality of 
storing portions, the bias portion may add an offset 
current to a signal current supplied from one of the 
two storing portions and may not add the offset current 
to the signal current supplied from the other storing 
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portion. As a result, the influence of an output to 
the calculating portion due to characteristic 
fluctuations of the individual storing portions can be 
suppressed . 

A second aspect of the present invention is a 
photographing device having a plurality of pixels, 
arranged on the same circuit in a matrix shape, for 
detecting brightness of an object, each of the pixels 
comprising : 

a light receiving portion for generating an 
electric signal corresponding to intensity of received 
light, 

an amplifying portion for amplifying an 
output signal of the light receiving portion, 

a plurality of storing portions for storing 
as, a current signal an electric signal amplified by the 
amplifying portion, 

a load portion for converting current outputs 
of the plurality of storing portions into voltages, 

a bias portion for supplying an offset 
current to an input of the load portion, 

a calculating portion for calculating an 
output signal of the load portion, and 

an outputting portion for outputting a 
calculated result of the calculating portion. 

In the photographing device of the second 
aspect of the present invention, the plurality of 



storing portions may store current signals 
corresponding to the received light in different 
periods. The calculating portion may perform a 
calculating process such as an addition, a subtraction, 
or a comparison for the voltage signals based on the 
current signals extracted from at least two of the 
plurality of storing portions. 

The amplifying portion may contain mirror 
transistors that are connected so that their gate 
electrodes face each other and amplify the current 
signals based on the theory of current mirror. 

The storing portion may store the current 
signals based on the theory of current copier. 

When the calculating portion compares the 
signal currents supplied from two of the plurality of 
storing portions, the bias portion may add an offset 
current to a signal current supplied from one of the 
two storing portions and does not add the offset 
current to the signal current supplied from the other 
storing portion. As a result, the influence of an 
output to the calculating portion due to characteristic 
fluctuations of the individual storing portions can be 
suppressed . 

A third aspect of the present invention is a 
photographing device for detecting brightness of an 
object, comprising : 

a pixel area in which pixels are arranged in 
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a matrix shape, each pixel being composed of a light 
receiving portion for generating an electric signal 
corresponding to intensity of received light and an 
amplifying portion for amplifying an output signal of 
the light receiving portion, 

a second amplifying portion area in which 
second amplifying portions are arranged in each column 
of the pixels in the pixel area, each of the second 
amplifying portions amplifying a current signal based 
on the theory of current mirror of mirror transistors 
that are connected so that their gate electrodes face 
each other, 

a pixel-outside storing area in which a 
plurality of storing portions are arranged in a matrix 
shape corresponding to the arrangement of the pixels in 
the pixel area, each of the storing portions storing as 
a current signal an electric signal that has been 
amplified, 

a load portion and calculating portion area 
in which load portions and calculating portions are 
arranged in each column of the pixels of the pixel 
area, each of the load portions converting the current 
output of the corresponding storing portion into a 
voltage, each of the calculating portions performing a 
calculating process, and 

an outputting portion area in which 
outputting portions are arranged in each column of the 



pixels of the pixel area, each of the outputting 
portions outputting the calculated result of the 
corresponding calculating portion, 

wherein the pixel area, the second amplifying 
5 portion area, the pixel-outside storing area, the load 

portion and calculating portion area, and the 
outputting portion area are disposed on the same 
circuit . 

In the photographing device of the third 
,3.0 aspect of the present invention, the storing portions 

■;rf may store current signals corresponding to the received 

O light in different periods. The calculating portions 

!|Q may perform a calculating process such as an addition, 

m 

'.g a subtraction, or a comparison for the voltage signals 

!<45 corresponding to the current signals extracted from two 

jfj 

^ or more of the storing portions. 

^ The photographing device may further 

ill comprises a bias portion for adding an offset current 

to an output current of the corresponding storing 
20 portion. In such a structure, when the calculating 

portion compares the signal currents supplied from two 
of the plurality of storing portions, the bias portion 
may add an offset current to a signal current supplied 
from one of the two storing portions and does not add 
25 the offset current to the signal current supplied from 

the other storing portion. As a result, the influence 
of an output to the calculating portion due to 
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characteristic fluctuations of the individual storing 
portions can be suppressed. 

The storing portion may store the current 
signals based on the theory of current copier. 

The present invention is a picture processing 
apparatus comprising a light receiving portion for 
generating an electric signal corresponding to 
intensity of received light, an amplifying portion for 
amplifying an output signal of the light receiving 
portion, a plurality of storing portions for storing as 
a current signal an electric signal amplified by the 
amplifying portion, a load portion for converting 
current outputs of the plurality of storing portions 
into voltages, a bias portion for supplying an offset 
current to an input of the load portion, and a 
calculating portion for calculating an output of the 
load portion. 

According to the structure of the picture 
processing apparatus of the present invention, since a 
storing portion and a photographing device are disposed 
on the same circuit, the process can be performed at 
high speed. In addition, since a bias portion adds an 
offset current to a current signal that is output from 
the storing portion and that has not been calculated, 
the influence of characteristics of the storing portion 
can be suppressed, thereby allowing an output of the 
calculating portion to become stable. 



For example, when the picture processing 
apparatus according to the present invention is used as 
a pixel and each pixel is arranged in a matrix shape on 
the same circuit, a photographing device with a 
calculating function can be structured- With the 
photographing device, a temporal change of brightness 
of an object can be calculated at high speed. 

These and other objects, features and 
advantages of the present invention will become more 
apparent in light of the following detailed description 
of a best mode embodiment thereof, as illustrated in 
the accompanying drawings . 
Brief Description of Drawings 

Fig. 1 is a schematic diagram showing the 
structure of a circuit of a photographing device 
according to an embodiment of the present invention; 
Fig. 2 is a schematic diagram showing the internal 
structure of a pixel disposed in the photographing 
device according to the embodiment; Fig. 3 is a 
schematic diagram showing the structure of a circuit of 
a light receiving portion 10, a first amplifying 
portion 20, a second amplifying portion 30, and a first 
storing portion 40-1 to a k-th storing portion 40-k; 
Fig^4^is a schematic diagram showing the structure of 
a circuit of a loading portion and calculating portion 
50 and an outputting portion 60; Fig. 5 is a timing 
chart showing operational characteristics of the 



photographing device shown in Fig. 1; Fig. 6 is a 
timing chart showing operational characteristics of 
which signal currents IM1, ... stored in a plurality of 
storing portions 40-1, ... are compared; Fig. 7 is a 
schematic diagram showing an example of the structure 
of a circuit of a bias portion 55; Fig. 8 is a 
schematic diagram showing a modification example of the 
structure of the photographing device shown in Fig. 1 
and the structure of the pixel shown in Fig.. 2; Fi g . 9 
is a schematic diagram showing another modification 
example of the structure of the photographing device 
shown in Fig. 1 and the structure of the pixel shown in 
Fig. 2; Fig. 10 is a timing chart of which a 
photographed picture is stored and read in the case 
that a CCD is used as the photographing device; Fig. 11 
is a timing chart showing operational characteristics 
of the photographing device shown in Fig. 9; F ig. 12 is 
a schematic diagram showing the structure of an active 
type distance measuring system to which the 
photographing device according to the embodiment is 
applied; Fi g. 13 is a top view showing the distance 
measuring system shown in Fig. 12; and Fi g . 1^4 is a 
schematic diagram showing a temporal change of light 
intensity that the photographing device receives and a 
calculated result of the change of the intensity by the 
photographing device . 

Best Modes for Carrying out the Invention 



Next f with reference to the accompanying 
drawings, an embodiment of the present invention will 
be described. 

Fig. 1 schematically shows the structure of a 
circuit of a photographing device according to the 
embodiment of the present invention. As shown in Fig. 
1, the photographing device is composed of m x n pixels 
1 arranged in a matrix shape. On the respective lines 
of the matrix, horizontal pixel drive signal groups 81- 

1, 81-2, . .., 81-n are disposed. On the respective 
columns of the matrix, vertical signal lines 91-1, 91- 

2, 91-m are disposed. 

The horizontal pixel drive signal groups 81 
contain signals that synchronously drive each portion 
(that will be described later) of the pixels. The 
signals are output from a vertical driving circuit 80. 
The vertical signal lines are signal lines for 
outputting photographed picture signals of the pixels. 
The vertical signal lines 91 are disposed toward a 
horizontal outputting portion 100. 

Fig. 2 shows the internal structure of one of 
the pixels 1 arranged in the photographing device. As 
shown in Fig. 1, the pixel 1 is composed of a light 
receiving portion 10, a first amplifying portion 20, a 
second amplifying portion 30, k storing portions of a 
first storing portion 10-1 to a k-th storing portion 
40-k, a load and calculating portion 50, a bias portion 



55, and an outputting portion 60. 

The light receiving portion 10 is a 
photoelectric converting portion. Conventionally, the 
light receiving portion 10 is composed of a photo diode 
(PD). The operation of the light receiving portion 10 
is controlled by a light receiving portion drive signal 
11. 

The first amplifying portion 20 converts a 
current signal transferred from the light receiving 
portion 10 into a level suitable for a process of the 
second amplifying portion 30 on the next stage of the 
first amplifying portion 20. In addition, the first 
amplifying portion 20 outputs the current signal at a 
timing defined by a first amplifying portion drive 
signal 21. 

The second amplifying portion 30 converts a 
current signal transferred from the first amplifying 
portion 20 into a level suitable for a processing 
process of each storing portion 4 0 on the next stage. 
In addition, the second amplifying portion 30 outputs 
the current signal at a timing defined by a second 
amplifying portion drive signal 31. 

The k storing portions of the first storing 
portion 40-1 to the k-th storing portion 40-k are 
connected to an output of the second amplifying portion 
30. The k storing portions store and hold the current 
of the amplified signal at a proper timing defined by a 




storing portion drive signal 41. The number k of 
storing portions disposed in one pixel depends on a 
calculating process performed on the next stage. 

The load portion and calculating portion 50 
5 is connected to all outputs of the first storing 

portion 40-1 to the k-th storing portion 40-k. The 
load portion and calculating portion 50 converts output 
currents of all or part of the storing portions 40 into 
corresponding voltages. In addition, the load portion 

10 and calculating portion 50 performs a calculating 

r* 

[;2 process at a proper timing defined by a calculating 

O portion drive signal 51. Although the calculating 

'.0 

!:Q process depends on the function of the photographing 

in 

\| device, the calculating process includes an addition, a 

i : =15 subtraction, a comparison, and so forth of signals. 

rs 

|;L S The bias portion 55 generates a bias current 

|£j for eliminating noise corresponding to a bias portion 

FU drive signal 56 so that the calculating portion 50 can 

properly perform the calculating process. 
20 The outputting portion 60 converts the 

calculated result of the load portion and calculating 
portion 50 into a level suitable for an output to 
signal lines of the photographing device. The 
outputting portion 60 outputs the converted signal as a 
25 pixel output 70 at a proper timing corresponding to an 

outputting portion drive signal 61. 

The drive signals 11 to 61 for each portion 
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are supplied as the horizontal pixel drive signal 
groups 81 to each pixel 1 of the photographing device. 
A vertical driving circuit 80 generates the drive 
signals 11 to 61 and drives m pixels arranged in the 
horizontal direction with the drive signals 11 to 61 . 

A pixel output 70 of each pixel is connected 
with the vertical signal lines 91, each of which 
connects pixels arranged in the column (vertical) 
direction. The vertical signal lines 91-1, 91-2, ... 
are connected to the horizontal outputting portion 100 
and extracted as a photographed picture signal 101 to 
the outside of the photographing device. 

When the number m of pixels that are 
horizontally arranged in the photographing device is 
small, the pixel output 70 may be converted into a 
proper level and then extracted as m parallel outputs 
to the outside of the photographing device. 

Next, the structure of a practical circuit of 
the pixel 1 according to the embodiment will be 
described. 

Fig. 3 shows the structure of the circuit of 
the light receiving portion 10, the first amplifying 
portion 20, the second amplifying portion 30, and the 
first storing portion 40-1 to the k-th storing portion 
40-k. 

The light receiving portion 10 is composed of 
a photodiode (PD) , a reset transistor (QR) , and a 



transfer transistor (QX) . A reset pulse (RST) is input 
to a gate terminal of the reset transistor (QR) . A 
transfer pulse (TX) is input as light receiving portion 
drive signals 11a and lib to a gate terminal of the 
transfer transistor (QX) . 

The first amplifying portion 20 is composed 
of an amplifying transistor (QA) and a read transistor 

(GR1) . A read pulse (RD) is input as a first 
amplifying portion drive signal 21 to a gate terminal 
of the read transistor (GR1) . 

The second amplifying portion 30 is composed 
of a current mirror circuit and a read transistor 

(GR2) . The current mirror circuit is composed of a 
mirror transistor (CM1) and a mirror transistor (CM2) 
whose gate electrodes face each other. A write pulse 

(WR) that defines a signal transfer timing for the 
storing portions 40 on the next stage of the second 
amplifying portion 30 is input as a second amplifying 
portion drive signal 31 to the read transistor (GR2) . 

Each of the first storing portion 40-1 to the 
k-th storing portion 40-k is composed of a memory 
transistor (Ml to Mk) , a memory gate transistor (Gl to 
Gk) , and a memory switch (SW1 to SWk) . A storage pulse 

(CK11 to CKkl) and a storage pulse (CK12 to CKk2) are 
input as storing portion drive signals 41a and 41b to 
the memory switch (SW1 to SWk) and the memory gate 
transistor (Ml to Mk) , respectively. 
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An output signal of the second amplifying 
portion 30 and input and output signals of the first 
storing portion 40-1 to the k-th storing portion 40-k 
are connected with a common signal line. In the 
5 following description, a current that passes through 

the signal line is denoted by a common signal IM. 

Fig. 4 shows the structure of a circuit of 
the load portion and calculating portion 50 and the 
outputting portion 60. 
10 The load portion and calculating portion 50 

Q is composed of a load transistor (QL) , an inverter 

□ 

Q (INV1) , an inverter (INV2), a. capacitor (CAP1), a 

i,y 

rg capacitor (CAP2), an inverter switch (SWA), and an 

inverter switch (SWB) . 
'Ll5 An inverter pulse CKA and an inverter pulse 

*«n CKB are input as calculating portion drive signals 51a 

0 

I III and 51b to a gate terminal of the inverter switch (SWA) 

j ; y and a gate terminal of the inverter switch (SWB) , 

respectively. 

20 A load bias voltage (VL) is input to a gate 

terminal of the load transistor (QL) . The load bias 
voltage (VL) defines the operation point of the load 
transistor (QL) . 

The capacitor (CAP1), the inverter (INV1), 

25 and the inverter switch (SWA) compose one chopper type 

comparator. Likewise, the capacitor (CAP2), the 
inverter (INV2), and the inverter switch (SWB) compose 
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one chopper type comparator. 

The outputting portion 60 is composed of a 
buffer amplifier (BA) and a pixel output gate (PTX) . 
An output pulse (CKO) is input as an outputting portion 
drive signal 61 to a gate terminal of the pixel output 
gate (PTX) . An output of the pixel output gate (PTX) 
becomes a pixel output (V0) of the pixel 1. 

Next, operational characteristics of one 
pixel 1 will be described. The operation of the pixel 
1 can be categorized as a reset period, a transfer 
period, a storage period, a calculation phase 1, and a 
calculation phase 2. 

[Reset Period] 

First of all, when the reset pulse (RST) is 
applied, the reset transistor (QR) is activated. As a 
result, the voltage on the drain side of the reset 
transistor (QR) (namely, a received light signal 
voltage (VA) ) is set to a predetermined voltage 
corresponding to the power supply voltage (the 
predetermined voltage is temporarily denoted by VR) . 

[Transfer Period] 

Thereafter, when a transfer pulse (TX) is 
applied, the transfer transistor (QX) is activated. As 
a result, in the storage period, signal electric 
charges (electrons) that have been photo-electrically 
converted by the photodiode (PD) of the light receiving 
portion 10 are transferred to the drain side of the 
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reset transistor (QR) . As a result, the received light 
signal voltage (VA) becomes the voltage corresponding 
to the number of signal electric charges. 
[Storage Period] 

The received light signal voltage (VA) is the 
gate voltage of the amplifying transistor (QA) of the 
first amplifying portion 20. Thus, when a read pulse 
(RD) is applied, the read transistor (GR1) is 
activated. As a result, a signal current corresponding 
to the received light" signal voltage (VA) flows to the 
mirror transistor (CM1) of the second amplifying 
portion 30. 

As a result, due to the theory of current 
mirror, a current with an amount that depends on the 
size ratio of the mirror transistor (CM1) flows to the 
other mirror transistor (CM2) . 

At that point, when a write pulse (WR) is 
applied, the read transistor (GR2) of the second 
amplifying portion 30 is activated. In addition, when 
a storage pulse (CK12) is applied, the memory gate 
transistor (Gl) of the first storing portion 40-1 is 
activated. Moreover, when a storage pulse (CK11) is 
applied, the memory switch (SW1) of the first storing 
portion 40-1 is activated. As a result, a current that 
passes through the mirror . transistor (CM2) flows to the 
memory transistor (Ml) . 

In addition, when the memory switch (SW1) is 



deactivated and then the memory gate transistor (Gl) 
and the transistor (GR2) are deactivated, the current 
that flows to the memory transistor (Ml) can be stored. 

Such a storing operation is accomplished in 
5 such a manner that the gate voltage that defines the 

value of the current that flows between the source and 
the drain of the memory transistor (Ml) is charged to a 
relatively smaller gate capacity (theory of current 
copier) . Thus, it is not necessary to charge a large 
capacity such as a capacitor. As a result, since the 
storing operation is completed in a short period, the 
operation time of the pixel 1 can be shortened. 

In the above example, the case that a current 
that corresponds to the received light signal voltage 
(VA) is stored to the memory transistor (Ml) of the 
first storing portion 40-1 was described. This 
operation can apply to the case that a current that 
corresponds to the received light signal voltage (VA) 
is stored to the other storing portions 40-2, 40- 
20 k. 

Thus, when a signal that has been photo- 
electrically converted in another period is stored to 
the memory transistor of another storing portion 40, a 
calculation that will be described later (for example, 
25 a comparison between signals) can be accomplished in 

the pixel 1 . 

Now, it is assumed that respective currents 
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that correspond to signals that have been photo- 
electrically converted in different periods have been 
stored in the memory transistor (Ml) of the first 
storing portion 40-1 and the memory transistor (M2) of 
the second storing portion 40-2. In this case, the 
currents that have been stored in the transistors Ml 
and M2 are denoted by IM1 and IM2, respectively. 
[Calculation Phase] 

When the memory gate transistor (Gl) of the 
first storing portion 40-1 is activated, the current 
IM1 stored in the memory transistor (Ml) flows to the 
load transistor (QL) . As a result, a voltage 
(temporarily denoted by VI) that depends on the amount 
of the current IM1 and the load bias voltage (VL) takes 
place on the electrode A side of the capacitor (CAP1) . 

However, when the load bias voltage (VL) is 
applied in only the period of the calculation phase 1 
and the loading bias voltage (VL) is 0 V in other 
periods, a current can be prevented from flowing to the 
load transistor (QL) . 

At that point, when the inverter switch (SWA) 
is activated so that the input and the output of the 
inverter (INV1) is short-circuited, a voltage (Vinvl) 
at the operation point of the inverter (INV1) takes 
place on the electrode B side of the capacitor (CAP1). 
As a result, a potential of the difference between VI 
and Vinvl takes place between the A side and the B side 



of the capacitor (CAP1) . 

In addition, after the inverter switch (SWB) 
that short-circuits the input and the output of the 
inverter (INV2) is activated along with the inverter 
switch (SWA) , the inverter switch (SWB) is deactivated 
just after the inverter switch (SWA) is deactivated. 
At that point, the output voltage (Vol) of the inverter 
(INV1) and the voltage (Vinv2) at the operation point 
of the inverter (INV2) are applied on the C side and 
the D side of the capacitor (CAP2). Thus, a potential 
of the difference takes place between both the sides. 

At that point, it should be noted that when 
the inverter switch (SWA) is deactivated from the 
activated state, each voltage on the input side and the 
output side of the inverter (INV1) may slightly 
fluctuate from voltages that take place when they are 
short-circuited due to the effect of charge injection. 
In the structure shown in Fig. 4, such a voltage 
fluctuation component can be absorbed by the capacitor 
(CAP2) . 

[Calculation Phase 2] 

Thereafter, when the memory gate transistor 
(G2) of the second storing portion 40-2 is activated, 
the current IM2 that is stored in the memory transistor 
(M2) flows to the load transistor (QL) . As a result, a 
voltage (temporarily denoted by V2) that depends on the 
amount of the current IM2 and the load bias voltage 



(VL) takes place on the electrode A side of the 
capacitor (CAP2) . 

At that point, when the voltage V2 is higher 
than the voltage VI , assuming that the input 
capacitance of the inverter (INV1) is as small as it 
can be ignored, the voltage on the B side of the 
capacitor (CAP1) rises by V2 - VI from the voltage 
(Vinvl) at the operation point. Thus, the signal level 
of the output of the inverter (INV1) becomes low. 

As a result, the voltage on the electrode D 
side of the capacitor (CAP2) becomes lower than the 
voltage (Vinv2) at the operation point. Thus, the 
signal level of the output of the inverter (INV2) 
becomes high. 

In contrast, when the voltage V2 is lower 
than the voltage VI, the voltage of the electrode B 
side of the capacitor (CAP1) lowers by VI - V2 from the 
voltage (Vinvl) at the operation point. Thus, the 
signal level of the output of the inverter (INV1) 
becomes high. 

As a result, the voltage on the electrode D 
of the capacitor (CAP2) becomes higher than the voltage 
(Vinv2) at the operation point. Thus, the signal level 
of the output of the inverter (INV2) becomes low. 

In other words, when the current IM2 stored 
in the memory transistor (M2) of the second storing 
portion 40-2 is larger than the current IM1 stored in 
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the memory transistor (Ml) of the first storing portion 
40-1, the signal level of the output of the calculating 
portion 50 becomes high. In contrast, when the current 
IM1 is larger than the current IM2, it is clear that 
the signal level of the output of the calculating 
portion 50 becomes low. 

In such a manner, the calculating portion 50 
can compare the amounts of currents stored in the 
storing potions 40 (namely, compare the intensities of 
received light) . 

An output of the calculating portion 50 is 
amplified to a proper level by the buffer amplifier 
(BA) of the outputting portion 60. When an output 
pulse (CK0) is applied, the pixel output gate (PTX) is 
activated. As a result, the amplified output is output 
as a pixel output VO. 

In the above-described operation, a 
calculated result for one pixel is obtained as a pixel 
output. Thus, when such phases from [storage period] 
to [calculation phase 2] are repeated corresponding to 
the number of pixels, pixel outputs can be obtained 
from the pixels 1 that are arranged in the vertical 
direction . 

Fig. 5 shows operational characteristics of 
the photographing device in the format of a timing 
chart. However, in Fig. 5, only clocks for two pixels 
are illustrated. 



In Fig. 5, [reset period] and [transfer 
period] are in common with all pixels. Alternatively, 
even if [reset period] and [transfer period] differ in 
each pixel, the above-described operations can be 
accomplished. However, in the latter case, the timing 
of the photo-electrically conversion slightly deviates 
in each pixel. 

In the above-described example, two signal 
currents that are stored are compared. However, in the 
structure of the pixel 1 according to the embodiment, 
three or more signal currents can be compared. 

It is assumed that four storing portions of 
first to fourth storing portions 40-1 to 40-4 are 
disposed and that signals currents IM1,.IM2, IM3, and 
IM4 that have been received and photo-electrically 
converted are stored to memory transistors Ml to M4, 
respectively. 

In the calculation phase 1 of the load 
portion and calculating portion 50, the memory gate 
transistors Gl and G2 are activated at the same time. 
Thus, the signal currents IM1 and IM2 flow to the load 
transistor (QL) . As a result, the load current VI 
takes place. 

In the calculation phase 2, the memory gate 
transistors G3 and G4 are activated at the same time. 
Thus, the signal currents IM3 and IM4 flow to the load 
transistor (QL) . As a result, the load current V2 
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takes place. 

According to the above-described operation 
theory, when V2 is larger than VI, the signal level of 
the output of the calculating portion 50 becomes high. 
In contrast, when V2 is smaller than VI, the signal 
level of the output of the calculating portion 50 
becomes low. In such a manner, the signal currents 
IM1, stored in the plurality of storing portions 

40-1 can be compared. 

Fig. 6 shows operational characteristics in 
the case that the signal currents IM1, . . . stored in 
the plurality of storing portions 40-1, . . . are 
compared in the form of a timing chart. However, in 
Fig. 6, drive clocks for one pixel are illustrated. 

Fig. 7 shows the structure of a circuit of 
the bias portion 55. The bias portion 55 adds an 
offset current to the input signal IM of the load 
portion and calculating portion 50 so as to eliminate 
influence of noise or the like. 

As shown in Fig. 7, the bias portion 55 is 
composed of a bias load transistor (BQL) , a bias 
transistor (BQ1), and a bias transistor (BQ2). The 
bias transistor (BQ1) and the bias transistor (BQ2) 
form a current mirror circuit. An offset bias voltage 
(VB) is applied to the gate terminal of the bias load 
transistor (BQL) . The operation point of the bias load 
transistor (BQL) is varied by the offset bias voltage 
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(VB) . An output of the bias transistor (BQ2) is 
extracted as a bias current (IB) . 

In the structure shown in Fig. 7, the offset 
bias voltage (VB) can be controlled from the outside. 
In the calculation phase 1, the bias current (IB) is 
added to the signal current that is extracted from the 
storing portion 40 and supplied to the load transistor 
(QL) of the calculating portion 50. In contrast, in 
the calculation phase 2, the bias current (IB) is not 
added to the extracted signal current. As a result, 
the output of the calculating portion 50 becomes 
stable. 

When the signal levels of two signals that 
are compared are almost the same and slightly change 
time by time, the output of the calculating portion 50 
repeatedly and unstably changes between the high level 
and the low level. To solve such a situation, as was 
described above, a bias current is superimposed to a 
current extracted in the calculation phase 1 so that 
the current extracted in the calculation phase 1 is 
larger than a current extracted in the calculation 
phase 2. As a result, the output of the calculating 
portion can be kept to either the low level or the high 
level (in this example, kept in the low level) so that 
the output of the calculating portion 50 becomes 
stable . 

When the current extracted in the calculation 



phase 2 is larger than the sum of the bias current 
component and the current extracted in the calculation 
phase 1, the output of the calculating portion 50 
changes from the low level to the high level. 

It is determined whether or not a current 
flows to the bias load transistor (BQL) depending on 
whether the offset bias voltage (VB) is applied. As a 
result, the value of the bias current (IB) depends on 
the effect of current mirror. However, to accurately 
control the value of the current, it is necessary to 
accurately control the offset bias voltage (VB) . Thus, 
there is a situation of which the offset bias voltage 
(VB) cannot be accurately controlled. In particular, 
the threshold voltage of the bias load transistor (BQL) 
fluctuates. The bias current (IB) varies for each 
pixel. Thus, the result may vary. 

To solve such a problem, the amount of the 
bias current (IB) is relatively varied by the 
difference of values of the offset bias voltage (VB) 
rather than the absolute value of the offset bias 
voltage (VB) so that an output of the calculating 
portion 50 can practically become stable. 

First of all, in the calculation phase 1, the 
offset bias voltage VB1 is applied to the bias load 
transistor (BQL) . The bias current that flows at the 
time is denoted by IB2 . Next, in the calculation phase 
2, when the offset bias voltage is denoted by VB2, the 
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bias current is denoted by IB2 . At that point, when 
the threshold voltages of the bias load transistors 
(BQL) are different from each other, the absolute 
values of IB1 and IB2 may largely vary. However, the 
difference IB1 - IB2 can be remarkably suppressed. As 
a result, the current difference supplied as a bias 
becomes stable in the calculation phase 1 and the 
calculation phase 2 . 

In addition, considering the effect of 
current mirror, when the sizes of the transistors . are 
designed so that the current that flows in the bias 
transistor (BQ2) is smaller than the current that flows 
in the bias transistor (BQ1) (namely, the bias load 
transistor (BQL) ) , the influence of the fluctuation of 
the threshold voltage can be reduced. 

Next, with reference to Fig. 3, in the pixel 
1 according to the present invention, the 
characteristics (namely, threshold voltages) of the 
memory transistors Ml to Mk as structural elements of 
the storing portions 40 can be suppressed from 
fluctuating . 

First of all, it is assumed that the gate 
voltage VA of the amplifying transistor (QA) of the 
first amplifying portion 20 is constant. 

At that point, when a read pulse (RD) is 
applied, the read transistor (GR1) is activated. As a 
result, a predetermined amount of current flows to the 



mirror transistor (CM1) that composes the current 
mirror . 

On the other hand, a predetermined amount of 
current that depends on the size ratio of the 
transistor CM1 flows in the other mirror transistor 
(CM2) that composes the current mirror as long as the 
mirror transistor (CM2) operates in the saturation 
region. In this example, the predetermined amount of 
current is temporarily denoted by IMA. 

When the read transistor (GR2), the memory 
gate transistor (Gl) , and the memory switch (SW1) are 
activated at the same time, IMA flows to the memory 
transistor (Ml) . 

At that point, the threshold voltage and the 
gate voltage (= drain voltage) of the memory transistor 
(Ml) are denoted by Vth-1 and VG-1, respectively. The 
common signal voltage between the memory gate 
transistor (Gl) and the read transistor (GR2) is 
denoted by VM-1. 

Likewise, when the above-described operation 
is performed for the memory transistor (M2) rather than 
the memory transistor (Ml), the current IMA flows to 
the memory transistor (M2). At that point, the 
threshold voltage and the gate voltage (= drain 
voltage) of the memory transistor (M2) are denoted by 
Vth-2 and VG-2, respectively. The common signal 
voltage between the memory gate transistor (G2) and the 



read transistor (GR2) is denoted by VM-2. 

When the size of the memory transistor (Ml) 
is completely the same as that of the memory transistor 
(M2) and the threshold value of the former is the same 
as that of the latter (namely, Vth-1 = Vth-2), as long 
as the same current flows thereto, the relations of VG- 
1 = VG-2 and VM-1 = VM-2 are satisfied. 

However, although the sizes of the 
transistors are the same, if their threshold voltages 
are different (namely, Vth-2 = Vth-1 + AVth) due to 
fluctuations in production (or another cause) , to allow 
the same current IMA to flow thereto, it is necessary 
to change the gate voltage VG-2 of the memory 
transistor by AVG and the common signal voltage VM-2 by 
AVM. 

Such voltage changes affect the drain voltage 
of the mirror transistor (CM2) of the current mirror 
circuit of the second amplifying portion 30. Unless 
the mirror transistor (CM2) operates in the saturation 
region, the current IMA does not flow unlike in the 
normal case. 

Thus, when the sizes of the memory 
transistors, the memory gate transistors, the read 
transistors, and the mirror transistors are properly 
selected, they have proper margins of operation points. 
In addition, when the mirror transistor is designed so 
that it always operates in the saturation state, even 
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if vqltage fluctuations AVG and AVM due to fluctuations 
of the threshold voltages take place, the signal 
current IMA that is stored does not change. 

Fig. 8 shows a modification example of the 
structure of the photographing device shown in Fig. 1 
and the structure of the pixel shown in Fig. 2. 

As are clear from the timing charts shown in 
Figs. 5 and 6, in n pixels arranged in the vertical 
direction, although the reset and transferring 
operation may be performed at the same time, the 
storing operation and the calculating operation can be 
performed at different times. Thus, it is not always 
necessary to dispose the second amplifying portion 30 
(which generates a signal current to be stored) , the 
load portion and calculating portion 50 (which 
processes a signal generated by the storing portion 
40), the outputting portion 60, and the bias portion 56 
in each pixel. In other words, they can be shared by a 
plurality of pixels. 

When these structural elements are disposed 
in each pixel, as the number of pixels increases, they 
may result in a bottleneck in producing the device. 
Thus, it is preferred to dispose these structural 
elements outside each pixel. 

In the structure of the pixel shown in Fig. 
8, in each of pixels 1-1 to pixel 1-n arranged in the 
vertical direction, only a light receiving portion and 



a first amplifying portion 20 are disposed. One second 
amplifying portion 30 is disposed for outputs of the 
pixel 1-1 to pixel 1-n. In other words, the second 
amplifying portion 30 is shared by a plurality of 
pixels on the same column. 

In addition, a pixel-outside storing portion 
2-1 to a pixel-outside storing portion 2-n are disposed 
corresponding to the pixel 1-1 to the pixel 1-n, 
respectively. Each of the storing portions 2-1, ... 
contains a first storing portion 40-1 to a k-th storing 
portion 40-k. 

On the other hand, a load portion and 
calculating portion 50 and an outputting portion 60 are 
shared by the pixel-outside storing portion 2-1 to the 
pixel-outside storing portion 2-n. Thus, even if the 
bias portion 55 is disposed in the photographing 
device, only one bias portion 55 is required for the 
load portion and calculating portion 50. 

Fig. 9 shows another modification example of 
the structure of the photographing device shown in Fig. 
1 and the structure of the pixel shown in Fig. 2. In 
Fig. 8, n pixels arranged in the vertical direction of 
the photographing device and a calculation processing 
portion are illustrated. In contrast, in Fig. 9, such 
a circuit structure is repeated in the horizontal 
direction as pixels arranged in a matrix. 

In other words, in the example of the 
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photographing device shown in Fig. 9, a pixel area is 
composed of m x n pixels arranged in- the horizontal 
direction and the vertical direction of a matrix. 
Below the pixel area, m second calculating portions 30 
are disposed in the horizontal direction. Below the 
second calculating portions 30, a pixel-outside storing 
area is disposed. The pixel-outside storing area is 
composed of m x n pixel-outside storing portions 
arranged in the horizontal direction and the vertical 
direction of a matrix. Below the pixel-outside storing 
area, an area composed of load portions and calculating 
portions 50 and outputting portions 60 is disposed. 
Below the area, a horizontal outputting portion 100 is 
disposed . 

As with the example shown in Fig . 1 , a 
vertical driving circuit 80 supplies a light receiving 
portion drive signal 11 and a first amplifying portion 
drive signal 21 to the m pixels arranged in the 
horizontal direction. A second amplifying portion 
drive signal 31 is supplied to the second amplifying 
portions 30. A storing portion drive signal 41 is 
supplied to the pixel-outside storing portions 2. A 
calculating portion drive signal 51 is supplied to the 
load portions and calculating portions 50. An 
outputting portion drive signal 61 is supplied to the 
outputting portions 60. 

Outputs of the n pixel 1-1 to pixel 1-n 
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arranged in the vertical direction are connected by- 
vertical pixel signal lines 92. The signal lines are 
inputs of the second amplifying portions 30. Outputs 
of the second amplifying portions 30 are connected to 
all the n pixel-outside storing portion 2-1 to pixel- 
outside storing portion 2-n arranged in the vertical 
direction and inputs of the load portions and 
calculating portions 50. 

The circuit structures and operational 
characteristics of the light receiving portions 10, the 
first amplifying portions 20, the second amplifying 
portions 30, the storing portions 40, the load portions 
and calculating portions 50, the bias portions 55, and 
the outputting portions 60 disposed in the 
photographing device shown in Fig. 9 may be almost the 
same as those shown in Figs. 3, 4, and 5. 

The overall operation of the photographing 
device shown in Fig. 9 is almost the same as that shown 
in Fig. 1 except that drive signals for the second 
amplifying portions 30, the load and calculating 
portions 50, and the outputting portions 60 for n 
pixels arranged in the vertical direction are 
independent rather than in common. 

Fig. 11 is a timing chart showing operational 
characteristics of the photographing device shown in 
Fig. 9. The different between the timing charts shown 
in Figs. 11 and 5 is in that the write pulse '(WR) for 
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driving the read transistor (GR2) of the second 
amplifying portion 30, the inverter pulses (CKA) and 
(CKB) for driving the inverter switch (SWA) and the 
inverter switch (SWB) of the load portion and 
calculating portion 50, respectively, and the output 
pulse (CKO) of the outputting portion 60 are in common 
with n pixels arranged in the vertical direction. 

Last, an application example of the 
photographing device according to the embodiment will 
be described. 

Fig. 12 schematically shows an active type 
distance measuring system for measuring the distance to 
an object (for details of the theory of active type 
distance measurement, refer to for example "Measuring 
three-dimensional picture" by Iguchi and Sato, Sho-ko 
Do) . In the example shown in Fig. 12, an object is 
composed of a plane and an almost semi-cylinder. The 
plane faces the measuring system. The almost semi- 
cylinder protrudes from the front. 

Slit-shaped laser light radiated from a 
semiconductor laser (or a light emitting diode) is 
reflected by a rotating mirror. The reflected light 
travels toward the object. When the radiation of the 
laser light is synchronized with the rotation of the 
rotating mirror, the laser light can be scanned in the 
left and right directions of the drawing. A camera can 
photograph laser light that is radiated to the plan and 
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the semi-cylinder time by time. The photographing 
device (see Fig. 1 or Fig. 9) can be applied for the 
camera of the distance measuring system. 

Fig. 13 is a top view showing the distance 
measuring system shown in Fig. 12. 

The camera is composed of a photographing 
device of which a predetermined number of light 
receiving elements such as fine pixels are arranged in 
a two-dimensional matrix shape, each of pixels being 
capable of detecting the intensity of received light. 
The camera can collect the reflected light of the 
object with a lens, photograph the object, and obtain 
the position of the received light. 

One pixel P on the photographing device 
always observes only the direction of view line through 
the lens. The direction of view line is denoted by 0P. 

The rotating mirror that scans the laser 
light has its rotation center axis at the position 
apart from the optical axis of the lens by a distance 
B. Starting the rotation at time zero, the rotating 
mirror scans the slit-shaped laser light to the front 
surface of the object from the right to the left of the 
drawing. 

Since the pixel P observes only the direction 
0P of view line, if the object is placed at a position 
I shown in Fig. 13, only when the rotating mirror is 
rotated and the laser radiation angle becomes 01, the 
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pixel P can receive the reflected light of the front 

surface of the object. Likewise, if the object is 

placed at a position II, only when the rotating mirror 

is rotated and the laser radiation angle becomes 011, 

the pixel P can receive the reflected light of the 

front surface of the object. 

In such a case, with a geometric calculation 

such as a triangulation, the distances LI and LII 

between the distance measuring system and the object 

can be expressed by the following formulas. 
_ ffxtanQ/xtaneP 
tan©/ + tan0P 

_ ffxtan07/xtaneP 
tan Oil + tan GP 

In other words, with the radiation directions 
01 and 011 of laser light received by the pixel P, the 
distances LI and LII to the object can be uniquely 
obtained. 

In this case, both the radiation angles 01 
and 011 can be expressed as functions with respect to 
elapsed time t after which the rotating mirror starts 
rotating. Thus, the distances LI and LII to the object 
can be expressed as functions with respect to time t. 

Fig. 14 shows a temporal change of intensity 
of light received by the photographing device and a 
calculated result of which the change of the intensity 
is calculated by the photographing device. 

In the example shown in Fig. 14, at time TI, 
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the sign of the calculated result changes from minus to 
plus. Based on the change point of the sign, the peak 
time of the light intensity can be detected (however, 
in the example shown in Fig. 14, it is assumed that the 
photographing device has an output characteristic of 
which the amount of current decreases in proportion to 
the amount of received light (namely, the intensity of 
received light) . When the peak time of the light 
intensity can be detected, as was described above, the 
distance to the object can be obtained. 

In the example shown in Fig. 14, the 
calculating interval (namely, the sampling period of 
the photographing device) is denoted by AT. When AT is 
shortened, the resolution of the distance measurement 
can be improved. 

Next, the process that has been described 
with reference to Figs. 12 to 14 will be explained for 
the case that a conventional photographing device is 
used. 

The calculating interval AT is equivalent to 
the video rate for example around 30 Hz or 60 Hz. 
Thus, when the object is moving, it is very difficult 
to accurately measure the distance to the object. 

Even if the object is stopping, to obtain the 
distance of the entire front surface of the object, it 
is necessary to scan laser at each photographing timing 
of 30 Hz or 60 Hz. Thus, it will take a very long time 



to measure the distance. 

Moreover, the time necessary for the picture 
process for obtaining the laser position based on the 
photographed picture cannot be ignored. 

In contrast, when the photographing device 
according to the embodiment is applied, the calculating 
interval can be remarkably shortened. Thus, even if an 
object is moving, the distance thereto can be 
accurately measured. 

Although the present invention has been shown 
and described with respect to a best mode embodiment 
thereof, it should be understood by those skilled in 
the art that the foregoing and various other changes, 
omissions, and additions in the form and detail thereof 
may be made therein without departing from the spirit 
and scope of the present invention. To determine the 
sprit of the present invention, the aforementioned 
section of claims should be referenced. 

As was described above, according to the 
present invention, an excellent picture processing 
apparatus for obtaining the difference between picture 
frames can be provided so as to obtain a temporal 
change of brightness of an object. 

In addition, according to the preset 
invention, an excellent picture processing apparatus of 
which a photographing device and a storing portion for 
storing photographed data photographed thereby are 



disposed on the same circuit can be provided so as to 
perform a calculating process at high speed. 

Moreover, according to the present invention, 
an excellent picture processing apparatus that allows 
5 characteristics of a storing portion to be suppressed 

from fluctuating and an accurately calculated output to 
be obtained in a situation of which a temporal change 
of brightness of an object is small can be provided. 

According to the structure of the picture 
10 processing apparatus of the present invention, since a 

3 storing portion and a photographing device are disposed 
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3 on the same circuit, the process can be performed at 

r~s - 

!y high speed. In addition, since a bias portion adds an 

J! 

ijj offset current to a current signal that is output from 

=4.5 the storing portion and that has not been calculated, 

CSS 

:L f the influence of characteristics of the storing portion 
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<H can be suppressed, thereby allowing an output of the 

U calculating portion to become stable. 

For example, when the picture processing 

20 apparatus according to the present invention is used as 

a pixel and each pixel is arranged in a matrix shape on 
the same circuit, a photographing device with a 
calculating function can be structured. With the 
photographing device, a temporal change of brightness 

25 of an object can be calculated at high speed. 
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